منابع مشابه
Normalized information-based divergences
This paper is devoted to the mathematical study of some divergences based on the mutual information well-suited to categorical random vectors. These divergences are generalizations of the " entropy distance " and " information distance ". Their main characteristic is that they combine a complexity term and the mutual information. We then introduce the notion of (normalized) information-based di...
متن کاملNonparametric Estimation of Conditional Information and Divergences
In this paper we propose new nonparametric estimators for a family of conditional mutual information and divergences. Our estimators are easy to compute; they only use simple k nearest neighbor based statistics. We prove that the proposed conditional information and divergence estimators are consistent under certain conditions, and demonstrate their consistency and applicability by numerical ex...
متن کاملInformation Theoretic Divergences With Application To Information Fusion
Many modern day collaborative systems / system of systems (SoS) rely heavily on the sharing of information in order to improve performance, manage resources, and maximize overall capability. These types of systems are characterized by many decentralized nodes which can either all be identical or are divided into a finite set of specialized types. When information is shared within any SoS, the o...
متن کاملComparison of Information Theoretic Divergences for Sensor Management
In this paper, we compare the information-theoretic metrics of the Kullback-Leibler (K-L) and Renyi ( ) divergence formulations for sensor management. Information-theoretic metrics have been well suited for sensor management as they afford comparisons between distributions resulting from different types of sensors under different actions. The difference in distributions can also be measured as ...
متن کاملThe design of information systems: parti, formats and sketching
In this article it is argued that an information system must be treated as an artefact with a format. We need to see information systems design as based on architectonic and not tectonic thinking. Design based on architectonic thinking emphasizes (1) the task of giving form to a design proposal, and (2) the task of creating an overall structure for the information system. These two activities a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Machine Learning
سال: 2008
ISSN: 0885-6125,1573-0565
DOI: 10.1007/s10994-008-5054-x